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(54) Method and system for associating actions with semantic labels in electronic documents 



(57) A method and system are provided for associ- 
ating actions with semantic labels in an electronic doc- 
ument. The document is created or edited in an appli- 
cation program module and sections of the electronic 
document are annotated with semantic labels. The ap- 
plication program module passes the semantic labels to 
an action DLL. The action DLL is responsible for com- 
municating with the application program module, trans- 



mitting the labels to action plug-ins, and receiving, from 
the action plug-ins, the actions to be associated with the 
labels. The application program module communicates 
with the action DLL to retrieve the actions associated 
with the semantic labels and displays them to a user. 
The document may be created in extensible Markup 
Language (XML) and may be annotated using XML 
tags. The semantic labels may be associated with 
strings of text or graphical objects 
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Description 
Field of invention 

[0001] The present invention relates to a method and 
system for associating actions with semantic labels in 
an electronic document. 

Background of the Invention 

[0002] Electronic documents such as word process- 
ing documents, e-mail messages, and spreadsheet 
documents typically include semantic information which 
may be recognized as belonging to a particular semantic 
category and associated with one or more actions rele- 
vant to the category. Recognition and use of this seman- 
tic information provides increased interoperability be- 
tween desktop software applications and other desktop 
applications and/orweb-based applications. Exemplary 
functions, features, and operations may include auto- 
matically addressing an e-mail message, performing a 
look up in a cooperating database, providing a hyperlink 
to one or more Internet web pages and providing en- 
hanced content. 

[0003] One current scheme for recognizing strings in- 
volves utilizing an application program module to pass 
a string of text (e.g., a paragraph) entered into an elec- 
tronic document to a recognizer. The recognizer parses 
the string for known keywords which are then compiled 
into semantic categories. Each recognized string is then 
labeled with the title of the semantic category to which 
it belongs. For example, when a user types the string 
"Bob Smith" which is known to the recognizer as a key- 
word, the recognizer compiles the string into the seman- 
tic category labeled "name." After the string has been 
compiled, the application program module may display 
to the user a selection of actions associated with the 
semantic category label in the electronic document. For 
example, the semantic category label "name" may be 
associated with the action "Add name to contacts fold- 
er." 

[0004] Independent software developers are often not 
in the best position to determine all of the semantic in- 
formation that individual users need to be recognized in 
electronic documents. Current schemes, however, are 
limited in that they require strings of text in the electronic 
document to contain keywords which are known to a 
recognizer to incorporate semantic category labels and 
make actions available to the user. That is, if a string of 
text (e.g., a person's name) does not match a list of key- 
words known to the recognizer, the string will not be la- 
beled as a semantic category and no actions will be as- 
sociated with the string. Moreover, current schemes are 
further limited in that they are unable to recognize and 
associate actions with non-string data (e.g., images, 
photos, drawings, and other insertable objects) which 
may be in a document. 

[0005] Thus, there is a need for a method and system 



for allowing actions to be associated with arbitrary 
strings or other types of content, such as images, pho- 
tos, drawings and other insertable objects in an elec- 
tronic document without the need for recognition. 

5 

Summary of the Invention 

[0006] Illustrative embodiments of the present inven- 
tion satisfy the above described needs by providing a 
10 method and system for associating actions with seman- 
tical^ labeled strings of text or other content without the 
need for recognition. 

[0007] In one embodiment, the present invention pro- 
vides a method for associating actions with semantic la- 
's bels in an electronic document. When the document is 
created or edited in an application program module, sec- 
tions of the electronic document are annotated with se- 
mantic labels. In the present embodiment, the document 
may be created using extensible Markup Language 
20 (XML) and the semantic labels may be XML tags. The 
application program module then passes the labels to 
an action DLL. The action DLL is responsible for com- 
municating with the application program module, trans- 
mitting the labels to action plug-ins, and receiving, from 
25 the action plug-ins, the actions to be associated with the 
labels. The application program module communicates 
with the action DLL to retrieve the actions associated 
with the semantic labels and displays them to a user. 
The semantic labels may be associated with strings of 
30 text or graphical objects. 

[0008] These and otherfeatures, advantages, and as- 
pects of the present invention may be more clearly un- 
derstood and appreciated form a review of the following 
detailed description of the disclosed embodiments and 
35 by reference to the appended drawings and claims. 

Brief Description of the Drawings 

[0009] 

40 

Fig. 1 is a block diagram of a computer that provides 
the exemplary operating environment for the 
present invention. 

Fig. 2 is a block diagram illustrating an exemplary 
45 architecture for use in conjunction with an embodi- 
ment of the present invention. 
Fig. 3 is a flow chart illustrating a method for incor- 
porating semantic labels and actions during crea- 
tion of an electronic document in accordance with 
50 an illustrative embodiment of the present invention. 
Fig. 4 is a flow chart illustrating a method for asso- 
ciating actions with semantic labels in accordance 
with an illustrative embodiment of the present in- 
vention. 

55 

Detailed Description of Illustrative Embodiments 
[0010] The present invention is directed toward a 



3 



EP 1 376 392 A2 



4 



method and system for associating actions with seman- 
tic labels in an electronic document. 
[0011] In one embodiment, the invention is incorpo- 
rated into a suite of application programs referred to as 
"OFFICE," and more particularly is incorporated into a 5 
word processing application program entitled "WORD" 
and a spreadsheet application program entitled "EX- 
CEL," both marketed by Microsoft Corporation of Red- 
mond, Washington. Briefly described, the application 
programs allow a user to create and edit electronic doc- 
uments by entering characters, symbols, graphical ob- 
jects, and commands. 

[0012] In one embodiment, the present invention in- 
cludes associating actions with semantic labels in an 
electronic document. When the document is created in 
an application program module, sections of the electron- 
ic document are annotated with semantic labels. The 
application program module then passes the labels to 
an action DLL. The action DLL is responsible for com- 
municating with the application program module, trans- 
mitting the labels to action plug-ins, and receiving, from 
the action plug-ins, the actions to be associated with the 
labels. The application program module communicates 
with the action DLL to retrieve the actions associated 
with the semantic labels and displays them to a user, 
[001 3] Having briefly described an illustrative embod- 
iment of the present invention, an illustrative operating 
environment for the present invention is described be- 
low. 

Exemplary Operating Environment 

[0014] Referring now to the drawings, in which like nu- 
merals represent like elements throughout the several 
figures, aspects of the present invention and the exem- 
plary operating environment will be described. 
[0015] Fig. 1 and the following discussion are intend- 
ed to provide a brief, general description of a suitable 
computing environment in which the invention may be 
implemented. While the invention will be described in 
the general context of an application program that runs 
on an operating system in conjunction with a personal 
computer, those skilled in the art will recognize that the 
invention also may be implemented in combination with 
other program modules. Generally, program modules in- 
clude routines, programs, components, data structures, 
etc. that perform particular tasks or implement particular 
abstract data types. Moreover, those skilled in the art 
will appreciate that the invention may be practiced with 
other computer system configurations, including hand- 
held devices, multiprocessor systems, microprocessor- 
based or programmable consumer electronics, cell 
phones, minicomputers, mainframe computers, and the 
like. The invention may also be practiced in distributed 
computing environments where tasks are performed by 
remote processing devices that are linked through a 
communications network. In a distributed computing en- 
vironment, program modules may be located in both lo- 



cal and remote memory storage devices. 
[0016] With reference to Fig. 1 , an exemplary system 
for implementing the invention includes a conventional 
personal computer 20, including a processing unit 21 , a 
system memory 22, and a system bus 23 that couples 
the system memory to the processing unit 21 . The sys- 
tem memory 22 includes read only memory (ROM) 24 
and random access memory (RAM) 25. A basic input/ 
output system 26 (BIOS), containing the basic routines 
that help to transfer information between elements with- 
in the personal computer 20, such as during start-up, is 
stored in ROM 24. The personal computer 20 further in- 
cludes a hard disk drive 27, a magnetic disk drive 28, e. 
g., to read from or write to a removable disk 29, and an 
optical disk drive 30, e.g., for reading a CD-ROM disk 
31 or to read from or write to other optical media. The 
hard disk drive 27, magnetic disk drive 28, and optical 
disk drive 30 are connected to the system bus 23 by a 
hard disk drive interface 32, a magnetic disk drive inter- 
face 33, and an optical drive interface 34, respectively. 
The drives and their associated computer-readable me- 
dia provide nonvolatile storage for the personal compu- 
ter 20. Although the description of computer-readable 
media above refers to a hard disk, a removable mag- 
netic disk and a CD-ROM disk, it should be appreciated 
by those skilled in the art that other types of media which 
are readable by a computer, such as magnetic cas- 
settes, flash memory cards, digital video disks, Bernoulli 
cartridges, and the like, may also be used in the exem- 
plary operating environment. 

[0017] A number of program modules may be stored 
in the drives and RAM 25, including an operating system 
35, one or more application programs 36, a word proc- 
essor program module 37 (or other type of program 
module), program data 38, and other program modules 
(not shown). 

[0018] A user may enter commands and information 
into the personal computer 20 through a keyboard 40 
and pointing device, such as a mouse 42. Other input 
devices (not shown) may include a microphone, joy- 
stick, game pad, satellite dish, scanner, or the like. 
These and other input devices are often connected to 
the processing unit 21 through a serial port interface 46 
that is coupled to the system bus, but may be connected 
by other interfaces, such as a game port or a universal 
serial bus (USB). A monitor 47 or other type of display 
device is also connected to the system bus 23 via an 
interface, such as a video adapter 48. In addition to the 
monitor, personal computers typically include other pe- 
ripheral output devices (not shown), such as speakers 
or printers. 

[0019] The personal computer 20 may operate in a 
networked environment using logical connections to 
one or more remote computers, such as a remote com- 
puter 49. The remote computer 49 may be a server, a 
router, a peer device or other common network node, 
and typically includes many or all of the elements de- 
scribed relative to the personal computer 20, although 
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only a memory storage device 50 has been illustrated 
in Figure 1 . The logical connections depicted in Figure 
1 include a local area network (LAN) 51 and a wide area 
network (WAN) 52. Such networking environments are 
commonplace in offices, enterprise-wide computer net- 
works, intranets and the Internet. 
[0020] When used in a LAN networking environment, 
the personal computer 20 is connected to the LAN 51 
through a network interface 53. When used in a WAN 
networking environment, the personal computer 20 typ- 
ically includes a modem 54 or other means for estab- 
lishing communications over the WAN 52, such as the 
Internet. The modem 54, which may be internal or ex- 
ternal, is connected to the system bus 23 via the serial 
port interface 46. In a networked environment, program 
modules depicted relative to the personal computer 20, 
or portions thereof, may be stored in the remote memory 
storage device. It will be appreciated that the network 
connections shown are exemplary and other means of 
establishing a communications link between the com- 
puters may be used. 

[0021] Fig. 2 is a block diagram illustrating an exem- 
plary architecture 200 for use in conjunction with an em- 
bodiment of the present invention. The architecture in- 
cludes an application program module 205, such as 
word processor program module 37 (Fig. 1). The appli- 
cation program module 205 is able to communicate with 
an action dynamic-link library 215 (hereinafter action 
DLL) as a user is creating, editing, viewing, etc. an elec- 
tronic document. An action is a user-initiated function 
applied to a typed string or other content such as imag- 
es, photographs, or drawings. The action DLL 215 con- 
trols a number of action plug-ins 225. The action DLL 
also controls a type-action database 230. 
[0022] In an illustrative embodiment, the action plug- 
ins are Automation Servers. Automation Servers are 
well-known software components which are assembled 
into programs or add functionality to existing programs 
running on the Microsoft WINDOWS® operating sys- 
tem. Automation Servers may be written in a variety of 
computing languages and may be un-plugged from a 
program at run time without having to recompile the pro- 
gram. 

[0023] The action DLL 21 5 manages the action plug- 
ins 225 that are run to execute the actions. The action 
plug-ins 225 may be packaged with the application pro- 
gram module 205 or written by third parties to perform 
particular actions that are of interest to the third party. 
The action plug-ins provide possible actions to be pre- 
sented to the user based upon the type label associated 
with the string or other content. The action DLL 21 5 de- 
termines what type label the semantic category includes 
and cross-references the type label in the type-action 
database 230 with a list of actions to determine what 
actions to present to the user. It should be understood 
that, in an illustrative embodiment, the type-action da- 
tabase is not used. Instead, the list of actions is dynam- 
ically generated for each type by looking in the registry 



to determine which actions are installed and then que- 
rying the action DLLs to determine which types they ap- 
ply to. 

[0024] After the user chooses an action, the action 
5 DLL 215 manages the appropriate action plug-ins 225 
and passes the necessary information between the ac- 
tion plug-ins and the application program module 205 
so that the action plug-in may execute the desired ac- 
tion. Typically, the application program module sends 
10 the action DLL an automation request to invoke the ac- 
tion the user has selected. 

[0025] A download URL may be provided with the 
type labels in case the user's machine has not stored 
action plug-ins for these type labels. If the user does not 

15 have the action plug-in DLL 225 corresponding to a la- 
bel, then the download URL may be used to navigate 
the user's web browser to an appropriate website to 
download this action plug-in. In other implementations 
of the invention, multiple download URLs may be pro- 

20 vided for a single type label. 

[0026] Having described an exemplary architecture, 
an exemplary method 300 for semantically labeling 
strings during document creation will be described be- 
low in reference to Figs. 2 and 3. 

25 

Method for Incorporating Semantic Labels and 
Actions during Document Creation 

[0027] Fig. 3 is a flow chart illustrating a method 300 
30 for incorporating semantic labels and actions during cre- 
ation of an electronic document. Those skilled in the art 
will appreciate that this is a computer-implemented 
process that is carried out by the computer in response 
to input from the user and instructions provided by a pro- 
35 gram module. In this embodiment, the user may be a 
software developer. 

[0028] Referring to Fig. 3, the method 300 begins at 
start step 305 and proceeds to step 310 when the de- 
veloper creates the electronic document in application 

40 program module 205. In one embodiment of the present 
invention, the document may be in a template format 
allowing a user to input strings of text, or other content, 
such as an image, photo or drawing, relevant to the doc- 
ument. For example, if the document is a will template, 

^5 the document may have sections for the user to input 
information such as name, place of residence, executor 
of the estate, and beneficiaries. Or if the document is a 
news article, the document may have sections for the 
user to insert a related photo. Or if the document is a 

50 business publication, it may have sections for a logo 
graphical element. In an illustrative embodiment, the 
electronic document is a word processing document or 
a spreadsheet document. However, the method is not 
limited to either of these specific types of electronic doc- 

55 uments. 

[0029] At step 310, sections of the document are an- 
notated with semantic labels which are to be associated 
with actions built by the developer. For example, if the 
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document being created is a will template having a sec- 
tion that requests a person's residence and that section 
is annotated with the semantic label "Place of Resi- 
dence," then actions for the "Place of Residence" label 
will be available for that section regardless of the text 5 
string input by the user. In one embodiment of the 
present invention, the document is created in XML and 
annotated using XML tags to label the document. The 
XML may be written using any editing tool or XML editing 
tool. For example, the residence section of the will tem- 
plate would be annotated with the <place of residence> 
XML element. The method 300 then proceeds to step 
315. 

[0030] At step 315, the developer builds action plug- 
ins 225 to provide and execute the actions for each se- 
mantic label (e.g., XML element) in the annotated doc- 
ument. After a string is labeled with a particular semantic 
label, the user will be able to execute action plug-ins 
pertaining to that label. For example, for the "Place of 
Residence" label in a will document, the developer may 
build actions which provide the user with the option to 
review the laws relating to wills which are particular to 
the user's state of residence. The method 300 then ends 
at step 399. 

Method for Associating Actions with Semantic 
Labels 

[0031] Fig. 4 is a flow chart illustrating a method 400 
for associating the created semantic labels with the ac- 
tion plug-ins 225 discussed in Figs. 2 and 3 above. 
Those skilled in the art will appreciate that this is a com- 
puter-implemented process that is carried out by the 
computer in response to input from the user and instruc- 
tions provided by a program module. 
[0032] Referring to Fig. 4, the method 400 begins at 
start step 405 and proceeds to step 410 when a user 
opens an electronic document (e.g., the will template 
described in Fig. 3) in application program module 205. 
In one embodiment, the electronic document is a word 
processing document or a spreadsheet document. 
However, the invention is not limited to either of these 
specific types of electronic documents. 
[0033] At step 415, the user hovers a cursor over a 
string or places the insertion point within a string in a 
section of the document incorporating a semantic label 
causing a dropdown menu to be displayed to the user 
in step 420. The dropdown menu typically displays a list 
of actions associated with a semantic label. The drop- 
down menu typically appears above and to the left of 
the semantic label. For example, if the user types the 
string "Redmond, Washington" in the section labeled 
"Place of Residence" the dropdown menu might display 
an action allowing the user to review the law relating to 
wills in the state of Washington. It should be understood 
that the application program module 205 sends a re- 
quest to the action DLL 215 to determine which actions 
are shown with each semantic label. The method then 



proceeds to step 425. 

[0034] In one embodiment of the invention, applica- 
tion program module 205 may include the option to dis- 
play an in-document user interface to indicate the loca- 
tion of a semantic label. This in-document user interface 
may use a colored indication to indicate the location of 
a semantic label such as brackets or underlining. For 
example, if the user types the string "Redmond, Wash- 
ington" in the section of the document labeled as a se- 
mantic category with type label "Place of Residence," 
the document may look like this with the brackets indi- 
cating semantic labeling: 

[Redmond, Washington] 

[0035] Of course, the in-document user interface may 
be any sort of indication. 

[0036] At step 425, the user is given the option of se- 
lecting one of the actions from the dropdown menu dis- 
played in step 415. If the user does not select an action, 
the dropdown menu remains displayed until the userpo- 
sitions the cursor or insertion point to another section of 
the document. If the user does select an action from the 
dropdown menu (i.e., by clicking on a selection), the 
method proceeds to step 430. 
[0037] At step 430, after the user has selected an ac- 
tion, the action DLL retrieves the selected action from 
the appropriate action plug-in. The action plug-ins pref- 
erably are COM objects that are executed via commu- 
nication between the application program module and 
the action DLL. Parameters necessary to execute the 
action (the XML markup of the string labeled as being 
of a particular type, the XML markup of the content rep- 
resenting the current selection) will be passed from the 
application program module to the action DLL and, in 
turn, passed to the action plug-in. After an action has 
been executed, the method returns to step 410 in which 
the user may reposition the cursor or hover over another 
semantic label in the document. The method 400 then 
ends at step 499. 

[0038] In another embodiment, actions may be asso- 
ciated with sections of existing documents. For exam- 
ple, a court might receive a legal document, such as a 
property deed, in electronic form. The property deed 
may already have a specific structure such as the loca- 
tion of the property, the amount paid, and a description 
of the property boundaries. A developer may annotate 
the structure of the document with semantic labels in a 
particular schema (e.g., XML) and build actions to pro- 
vide functionality for particular elements of the schema 
that appear in the document. Thus, an action associated 
with the location section of the deed may cause a map 
showing the property to be displayed. 
[0039] Although the illustrative embodiments of the 
present invention have been described as implemented 
in a word processing program module, it should be un- 
derstood that the present invention may be implement- 
ed in other program modules, including, but not limited 
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to, XML authoring programs and programs such as the 
"POWERPOINT"® presentation graphics program, the 
"VISIO" diagram drawing program and applications in- 
cluded in the "OFFICE" program module, both marketed 
by Microsoft Corporation of Redmond, Washington. 
[0040] The architecture of embodiments of the 
present invention is designed to allow developers to pro- 
vide actions for labeled strings or other content such as 
graphical objects which may include, for example, im- 
ages, photographs, or drawings. The strings or other 
content may be associated with actions without the need 
for recognizer DLLs or recognizer plug-ins which are 
limited because they are string based and thus do not 
accurately recognize non-string content. The developer 
may annotate sections of the document with semantic 
labels so that the actions will be available no matter what 
is inserted in the annotated section by the user. The ar- 
chitecture also allows developers to write less code to 
provide actions since no recognition is required. 
[0041] It should be understood that illustrative embod- 
iments of the present invention are designed to be able 
to function without any action plug-in DLLs. For exam- 
ple, if there are no action plug-in DLLs, then the user 
may be presented with a menu item that allows the user 
to goto a download site to install an action plug-in DLL. 
[0042] Although the present invention has been de- 
scribed above as implemented in illustrative embodi- 
ments, it will be understood that alternative embodi- 
ments will become apparent to those skilled in the art to 
which the present invention pertains without departing 
from its spirit and scope. Accordingly, the scope of the 
present invention is defined by the appended claims 
rather than the foregoing description. 



Claims 

1 . For an electronic system for creating and editing an 
electronic document, a method for associating ac- 
tions with semantic labels in the electronic docu- 
ment created in an application program module, the 
method comprising the steps of: 

annotating the electronic document with a plu- 
rality of the semantic labels; 
receiving the plurality of labels in an action dy- 
namic link library; 

transmitting the plurality of labels to a plurality 
of action plug-ins; and 

determining, in the action plug-ins, a plurality of 
actions based on the labels. 

2. The method of claim 1 , wherein the step of anno- 
tating the electronic document with a plurality of se- 
mantic labels comprises annotating the electronic 
document with a plurality of extensible Markup Lan- 
guage (XML) elements. 



3. The method of claim 1 , further comprising display- 
ing the plurality of actions received from the action 
plug-ins. 

s 4. The method of claim 1 , wherein the plurality of ac- 
tions are predetermined for each of the plurality of 
labels. 

5. A method for associating actions with content in an 
10 electronic document as the electronic document is 

created in an a application program module, the 
method comprising the steps of: 

as the content is entered into the electronic 
15 document, associating the content with a se- 

mantic label, wherein the electronic document 
is annotated with a plurality of semantic labels; 
and 

determining a plurality of the actions associat- 
20 ed with the label. 

6. The method of claim 5, further comprising display- 
ing an indication that the label has been found for 
the content . 

25 

7. The method of claim 6, further comprising the steps 
of: 

determining that a user has selected the con- 
30 tent; and 

in response, displaying the plurality of actions 
to the user. 

8. The method of claim 5, further comprising the steps 
35 of: 

receiving an indication that one of the plurality 
of actions has been selected; and 
in response to receiving an indication that one 
40 of the plurality of actions has been selected, 

then causing the application program module 
to execute the selected action. 

9. The method of claim 5, wherein the step of associ- 
45 ating the content with a semantic label comprises 

associating a string of text with the semantic label. 

10. The method of claim 5, wherein the step of associ- 
ating the content with a semantic label comprises 

50 associating a graphical object with the semantic la- 
bel. 

1 1 . The method of claim 8, wherein the application pro- 
gram module executes the selected action by de- 

55 termining whether an action plug-in dynamic link li- 
brary assigned to the action is available; and 

if so, then receiving instructions from the ac- 
tion dynamic link library assigned to the selected ac- 
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tion. 

12. The method of claim 11, further comprising the 
steps of: 

if an action plug-in dynamic link library is not 
available, then using a Uniform Resource Lo- 
cator assigned to the action to navigate to a 
Web site and download the action plug-in dy- 
namic link library. 

13. A system for associating actions with semantic la- 
bels in an electronic document, the system compris- 
ing: 

an application program module for annotating 
the electronic document with a plurality of the 
semantic labels; 

an action dynamic link library connected to the 
application program module receiving the plu- 
rality of labels; and 

a plurality of action plug-ins connected to the 
action dynamic link library for receiving the plu- 
rality of labels and determining a plurality of ac- 
tions based on the labels. 

14. The system of claim 1 1 , wherein the semantic labels 
are extensible Markup Language (XML) elements. 

15. The system of claim 11 further comprising a display 
module for receiving and displaying the plurality of 
actions received from the action plug-ins. 

16. For an electronic system for creating and editing an 
electronic document, a computer-readable medium 
having computer-executable instructions for asso- 
ciating a plurality of actions with semantic labels in 
the electronic document created in an application 
program module, comprising: 

annotating the electronic document with a plu- 
rality of the semantic labels; 
receiving the plurality of labels in an action dy- 
namic link library; 

transmitting the plurality of labels to a plurality 
of action plug-ins; and 

determining, in the action plug-ins, the plurality 
of actions based on the labels and displaying 
the plurality of actions received from the plural- 
ity of action plug-ins. 

1 7. The computer-readable medium of claim 1 2, where- 
in annotating the electronic document with a plural- 
ity of semantic labels comprises annotating the doc- 
ument with a plurality of extensible Markup Lan- 
guage (XML) elements. 

18. A computer-readable medium having computer-ex- 



ecutable instructions for associating actions with 
content in an electronic document as the electronic 
document is created in an a application program 
module, comprising: 

5 

as the content is entered into the electronic 
document, associating the content with a se- 
mantic label, wherein the electronic document 
is annotated with a plurality of semantic labels; 
10 and 

determining a plurality of the actions associat- 
ed with the label; 

receiving an indication that one of the plurality 
of actions has been selected; and 
15 in response to receiving an indication that one 

of the plurality of actions has been selected, 
then causing the application program module 
to execute the selected action. 

20 19. The computer-readable medium of claim 18, where- 
in associating the text with a semantic label com- 
prises associating the text with an extensible 
Markup Language (XML) element. 

25 20. The computer-readable medium ofclaim 18, further 
comprising displaying an indication that the label 
has been found for the content. 

21 . The computer-readable medium ofclaim 1 8, where- 
30 jn the application program module executes the se- 
lected action by determining whether an action 
plug-in dynamic link library assigned to the action 
is available; and 

if so, then receiving instructions from the ac- 
35 tion dynamic link library assigned to the selected ac- 
tion. 

22. The computer-readable medium ofclaim 1 8, where- 
in associating the content with a semantic label 

40 comprises associating a string of text with the se- 
mantic label. 

23. The computer-readable medium ofclaim 1 8, where- 
in associating the content with a semantic label 

45 comprises associating a graphical object with the 
semantic label. 

24. The computer-readable medium ofclaim 20, further 
comprising the steps of: 

50 

if an action plug-in dynamic link library is not 
available, then using a Uniform Resource Lo- 
cator assigned to the action to navigate to a 
Web site and download the action plug-in dy- 
55 namic link library. 

25. For an electronic system for creating and editing an 
electronic document, a method for associating ac- 
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tions with extensible Markup Language elements 
(XML) in the electronic document created in an ap- 
plication program module, the method comprising 
the steps of: 

5 

annotating the electronic document with a plu- 
rality of the XML elements; 
receiving the plurality of XML elements in an 
action dynamic link library; 
transmitting the plurality of XML elements to a 10 
plurality of action plug-ins; and 
determining, in the action plug-ins, a plurality of 
actions based on the XML elements. 

26. The method of claim 25, further comprising display- '5 
ing the plurality of actions received from the action 
plug-ins. 

27. The method of claim 25, wherein the plurality of ac- 
tions are predetermined for each of the XML ele- 20 
ments. 
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